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COMMUNICATION APPARATUS, ITS CONTROL METHOD, 
AND STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

The present invention relates to a communication 
apparatus which receives and displays image data and 
the like sent from, e.g., a communication apparatus at 
a remote location connected through a communication 

10 network, a control method for the communication 
apparatus, and a storage medium. 
Related Background Art 

One video transmission system has been proposed. 
In this system, for example, plural video cameras and 

15 computers are located inside a building, and these 

video cameras and the computers are networked through 
communication lines, thereby realizing video 
transmission among plural desired points and 
interactive communication by video and audio. 

20 In such the video transmission system, a user of 

the computer at one point can remote-control the video 
camera at the desired point and display the video taken 
by the remote-controlled video camera on the screen of 
own computer . 

25 Further, in the video transmission system capable 

of remote-controlling the video camera, especially, as 
the number of the video cameras to be remote-controlled 
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increases, it is necessary for the user to easily 
understand where each video camera is located. Thus, 
the technique which superimposes a camera symbol 
representing the location of each video camera on an 
5 image representing a map has been proposed. Further, 
the technique which represents the direction of the 
actual video camera by displaying the direction of the 
camera symbol has been proposed. 

Further, a method of controlling the video camera 

10 by transferring a camera control parameter stored as 
preset ( control ) information to the video camera has 
been proposed. 

In the above system, the user can quickly and 
precisely control the video camera to a desired object 

15 by using the preset (control) information, and a 
necessary video can be obtained - 

However, in a conventional system, the preset 
(control) information is managed on a user interface as 
sequential number or a title of an object or scenery to 

20 be displayed (for example, "Reception" or "front of 
Elevator"). That is, there was a problem that 
relationship between each of two preset information 
(i.e., imaging direction change of a sequential number 
1 and a sequential number 2 ) had not been intuitively 

25 known. 

Further, the preset information is applied to the 
video camera by selecting the sequential number or the 
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title on the user interface using a mouse or a 
keyboard. That is, when an operator wants to control 
the video camera mainly referring to the map, since 
cursor movement (shift) by the mouse was frequently 
5 required, a complex operation has been brought. 

CJ SUMMARY OF THE INVENTION 

\Q 

[is An object of the present invention is to solve the 

U 

iO above problem and realize that an operator can easily 

fn 

vi 10 grasp the state change of an imaging apparatus, to 

2 which stored control information is applied, on a map. 

Another object of the present invention is to 

"is 

»5 provide a means for applying the stored control 

information to the imaging apparatus using the map and 

15 realize to operate the imaging apparatus mainly 
referring to the map. 

In order to solve the above problem, the present 
invention provides a communication apparatus which 
receives image data imaged (taken) by the imaging 

20 apparatus connected through a network, comprises a 

storage means (store preset information) for storing 
control information to control the imaging apparatus, 
an output means (display a camera icon) for outputting 
to a display unit a synthetic image which is obtained 

25 by synthesizing a symbol representing a state of the 
imaging apparatus to image information indicating a 
setting location of the imaging apparatus in accordance 



- 4 - 



with the control information stored in the storage 
means, and an output means (display a preset symbol) 
for outputting to the display unit a synthetic image 
which is obtained by synthesizing a symbol 
5 corresponding to the control information stored in the 
storage means to the image information. The 
communication apparatus further comprises a means 
11 (shift (move) a preset symbol) for determining a 

synthesizing position when the symbol corresponding to 
10 the control information is synthesized to the image 
information, and a control means (control a video 
camera by clicking a preset symbol) for controlling the 
control information to control the imaging apparatus is 
to be applied to the imaging apparatus by an operation 
15 to the symbol which corresponds to the control 
information . 

Still another object of the present invention is 
to provide a new function. 

Other features of the present invention will 
20 become apparent from the following embodiments and the 
attached drawings . 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the entire 
25 structure of a communication system including a video 

communication system according to one embodiment of the 
present invention ; 
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Fig. 2 Is a block diagram showing the structure of 
main software of a video transmitter 20 and a monitor 
60 according to one embodiment of the present 
invention; 

Fig. 3 is a view showing a display example of the 
monitor according to one embodiment of the present 
invention; 

Fig. 4 is a view showing a display example of the 
monitor according to one embodiment of the present 
invention; 

Fig. 5 is a view showing a display example of a 
window for displaying video from a video camera, 
according to one embodiment of the present invention; 

Fig. 6 is a view showing the state when display is 
performed by a drag-and-drop operation, according to 
one embodiment of the present invention; 

Fig. 7 is a view showing a mouse cursor of a video 
camera used in the drag-and drop operation according to 
one embodiment of the present invention; 

Fig. 8 is a view showing the state when a display 
area by the drag-and-drop operation is changed, 
according to one embodiment of the present invention; 

Fig. 9 is a view showing a camera icon 
representing that taken video is being displayed, 
according to one embodiment of the present invention; 

Fig. 10 is a view showing the state of an 
operation to stop the display by the drag-and-drop 
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operation according to one embodiment of the present 
invention; 

Fig, 11 is a view showing a bit map of a camera 
symbol according to one embodiment of the present 
invention; 

Fig. 12 is a flow chart showing an operation 
performed by a user when preset information is to be 
stored, in a certain monitor, according to one 



f|»i 

l-u embodiment of the present invention; 

f7j 10 Fig. 13 is a flow chart showing an operation 

pi" performed by the user when the preset information is 

transmitted to a video camera, in a certain monitor, 
according to one embodiment of the present invention; 
W Fig. 14 is a flow chart showing an operation 

C3 15 performed by the user when the preset information is to 

be deleted, in a certain monitor, according to one 
embodiment of the present invention; and 

Fig. 15 is a flow chart showing an operation 
performed by the user when the preset information is 
20 transmitted to the video camera, in a certain monitor, 
according to one embodiment of the present invention. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, embodiments of a video communication 
25 system according to the present invention will be 
described in detail with reference to the attached 
drawings. 



Fig, 1 is a block diagram showing the entire 
structure of a communication system including a video 
communication system according to one embodiment of the 
present invention . 

In Fig. 1, numeral 10 denotes a video camera which 
generates video (or an image signal) on the basis of a 
taken image. Numeral 20 denotes a video transmitter 
such as a work station ( WS ) , a personal computer ( PC ) 
or the like which transmits the image signal from the 
video camera 10 to a monitor 60 and receives a control 
signal from the monitor 60 to control the video camera 
10. Numeral 60 denotes the monitor such as the WS, the 
PC or the like which receives the image signal from the 
video transmitter 20 and transmits the control signal 
to the video transmitter 20 to control the video camera 
10. 

The plural video transmitters 20 and the plural 
monitors 60 can communicate with others through a 
network 100. Preferably, the video transmitter 20 
analog- to-digital (A/D) converts the image signal from 
the video camera 10 into digital image data, compresses 
the obtained digital image data, and transmits the 
compressed data to the monitor 60 through the network 
100. 

Numeral 12 denotes a camera control circuit which 
controls panning, tilting, zooming, focusing and 
irising operations in accordance with the control 
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signal (i.e., a control code) from the video 
transmitter 20. The control signal is input from an 
input/output interface (I/O) 32 of the video 
transmitter 20 to the camera control circuit 12 on the 
5 basis of standards such as an RS-232C USB (Recommended 
Standard 232C for Universal Serial Bus), an IEEE 
(Institute of Electrical and Electronic Engineers) 1394 
standard , and the 1 ike . 

y s If the video camera 10 does not perform the 

fa'] 10 panning, tilting, zooming, focusing and irising 

operations, the camera control circuit 12 is not always 

I,,, necessary. However, it is preferable to control ON/OFF 

of the power supply of the video camera 10. 

H (Video Transmitter 20) 

E-J 15 Next, the structure of the video transmitter 20 

will be explained. Numeral 24 denotes a main memory, 
and numeral 26 denotes a storage unit such as a hard 
disk or the like. Numeral 28 denotes a mouse which 
acts as a pointing device. However, other devices such 

20 as a touch panel on a bit map display 35 and the like 
may be also used. Numeral 30 denotes a keyboard which 
acts as input means. Numeral 25 denotes an external 
memory from which a storage medium such as a floppy 
disk, a CD-ROM, an MO or the like is detachable. 

25 Numeral 32 denotes the I/O which is connected to the 
camera control circuit 12 to transmit and receive the 
control signal of the video camera 10. Numeral 34 
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denotes a video capture board which captures a video 
output signal VD of the video camera 10. The video 
output signal VD may be an analog signal such as a 
general NTSC (National Television System committee) 
5 signal or a digital signal. If the signal VD is. the 
analog signal, it is necessary for the video capture 
p board 34 to have an A/D conversion function. Numeral 

36 denotes a video board which obtains the video 
captured by the video capture board 34 through a system 
10 bus 39 and displays the obtained video at an arbitrary 
location on the bit map display 35. Numeral 38 denotes 
a network interface (I/F) which communicates with the 
monitor 60 through the network 100. The above units 
are connected to others through the system bus 39, and 
15 a CPU 22 controls the video transmitter 20 as a whole 

and the display of the bit map display 35 in accordance 
with software stored in the storage medium or the 
storage unit 26 or software obtained through the 
network 100. 

20 If the video capture board 34 does not have a data 

compression function, it is possible to provide 
software for realizing such the function, whereby the 
CPU 22 can perform data compression processing. 

By such the video transmitter 20 as structured 
25 above, the image data taken by the video camera 10 is 
transmitted to the monitor 60 at a remote location 
through the network 100, and the video camera 10 is 
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controlled according to the control code received from 
the monitor 60. It should be noted that there are the 
plural video transmitters 20 and the plural monitors 
60, and the video of the desired video transmitter can 
5 be received from any of the monitors. 
(Monitor 60) 

Next, the structure of the monitor 60 will be 
explained. It should be noted that, in the monitor 60, 
explanation of the devices or the units same as those 

10 in the video transmitter 20 will be omitted. A network 
I/F 138 receives the compressed image data from the 
video transmitter 20, A CPU 122 decompresses the 
received data (i.e., encoded data) by using a video 
compression decoder 33, and controls a video board 136 

15 on the basis of the decompressed image data to cause a 
bit map display 135 to display the image taken by the 
video camera 10 and the state of the video camera 10. 
Further, the CPU 122 transmits the control code to the 
video transmitter 20 for controlling the video camera 

20 10, in accordance with data input by the user of the 
monitor 60 with use of a keyboard 130 or a mouse 128. 

Next, the software of the video transmitter 20 and 
the monitor 60 according to the present embodiment will 
be explained. It should be noted that the software 

25 explained hereinafter is executed by the hardware of 
the video transmitter 20 or the monitor 60. 

Fig. 2 is a block diagram showing the structure of 



the main software of the video transmitter 20 and the 
monitor 60 according to one embodiment of the present 
invention. 

First, the software to be executed by the monitor 
60 will be explained. Numeral 411 denotes camera 
control client software which is to remote control the 
video camera 10 connected to the video transmitter 20. 
Numeral 412 denotes video reception software which is 
to decompress the compressed image data transmitted 
from the video transmitter 20 in the form of packet and 
display the decompressed image data. Further, the 
video reception software 412 is to manage image data 
received from all the video transmitters 20 (i.e., the 
video cameras 10) connected to the network 100. By the 
video reception software 412, a camera ID of each video 
camera, a host computer ID of the video transmitter 20 
to which the video camera concerned is connected, the 
information concerning the camera operation states such 
as the panning, tilting, zooming, focusing and irising 
operations, the information concerning whether or not 
the video camera concerned is controllable, the state 
information concerning which video camera is currently 
controlled, and the state information concerning which 
video camera is currently displayed are stored into the 
monitor 60. Also the camera control client software 
411 and map management software 413 share such the 
information, whereby the information is utilized to 
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camera symbol change or the like. Numeral 413 denotes 
the map management software which uses a GUI ( graphical 
user interface) function. The GUI function is to 
graphically display the location, the panning state and 
5 the tilting state of the video camera 10 and control 
the operation of the camera 10, by a map, the camera 

fS1 symbol and later-described scope display of Fig. 6. 

The above software is prestored into the storage unit 

r t. of the monitor 60. 

Vasr 

10 Next, the software to be executed by the video 

EH transmitter 20 will be explained. Numeral 421 denotes 

Q camera control server software which is to control the 

flj panning, tilting, zooming, focusing and irising 

Q operations of the video camera 10 connected to the 

pi 

15 video transmitter 20 and also capture the image data 
output from the video camera 10 to the video 
transmitter 20. Numeral 422 denotes video transmission 
software which cooperates with the camera control 
server software 421 and is to transmit the video to the 

20 monitor 60 currently controlling the video camera 10. 
Numeral 423 denotes map server software. The above 
software are prestored into the storage unit 26 of the 
video transmitter 20. 

It is needless to say that, in addition to the 

25 above software, software for controlling two-way 

communication through the network 100, software for 
controlling the storage units 26 and 126, software for 
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controlling -the external memories 25 and 125, and the 
like are prepared in the system. 
(User Interface) 

Next, the user interface in the present 
5 embodiment, i.e., a screen which is displayed on the 
bit map display 135, will be explained. To simplify 
the explanation, the user interface will be explained 
on the premise that one monitor 60 is connected to the 
video transmitter 20 through the network. 

10 Figs. 3 and 4 are views showing a display example 

of the monitor according to one embodiment of the 
present invention. Concretely, Figs. 3 and 4 show one 
example of the screen displayed on the bit map display 
135 of the monitor 60. In Fig. 3, numeral 500 denotes 

15 a map window in which the map is displayed. In the 

present embodiment, plural maps 510, 520, 530 and 540 
showing layouts of offices, establishments (or stores), 
warehouses and the like are managed within the map 
window 500. Since each map is added with a map tab, if 

20 the map tab is clicked by the mouse 128, the map added 
with the clicked tab is displayed up-front (as a map 
display area 502). At this time, the camera symbols 
are displayed on the up-front map. 

Fig. 3 shows the state that the map 520 is 

25 selected from among the maps 510 to 540 and displayed 
on the map display area 502. On the map 520, video 
camera symbols (or video camera icons) 521, 522, 523 
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and 524 are displayed as icons. At this time, if the 
map tab of the map 530 is clicked, the map 530 is 
displayed as shown in Fig. 4. 

In Fig. 4, the map 530 is displayed on the map 
display area 502, and video camera symbols (or video 
camera icons) 531 and 532 are displayed on the map 530. 

When the camera symbol is synthetically displayed 
on the map, if preset information for the camera symbol 
is stored into the storage unit of the monitor 60, a 
preset symbol is simultaneously displayed. 

Preset symbols 531-1 and 531-2 shown in Fig. 4 are 
the preset symbols of the camera symbol 531 and 
respectively represent a door and a stage. In the 
present embodiment, the preset symbol is represented by 
a circle bit map to which a serial number 1101 is 
annexed as shown in Fig. 11. 

Of course, the preset symbol is not limited to the 
above example but may be another preferable one such as 
a character symbol if the symbol can be corresponded to 
the preset information . 

In Fig. 4, reference mark 0 indicates a center 
point of the camera symbol 531, and a sector area AOB 
is formed by reference marks A, B and 0 as shown in 
Fig. 4. 

A dotted line OP indicates an initial direction of 
the camera symbol 531. A radius OA indicates left edge 
direction controllable for the camera symbol 531. A 



- 15 - 



radius OB indicates right: edge direction controllable 
for the camera symbol 531* 

The preset symbol is synthetically displayed on an 
arbitrarily designated position when an operator sets 
5 the preset information. 

For example, the preset symbol 531-1 is positioned 
on an image side of indicating the door and the preset 
symbol 531-2 is positioned on an image side of 
indicating the stage. 

10 When the preset information corresponding to each 

preset symbol is applied to an imaging apparatus, it is 
set that video near the door and video of the stage are 
respectively displayed . 

Of course, since the preset symbol is arbitrarily 

15 positioned, the operator can put the preset symbol on a 
desired position for a use of it. 

Fig. 5 is a view showing a display example of a 
window for displaying the video (or the image) from the 
video camera, according to one embodiment of the 

20 present invention. As shown in Fig. 5, in a window 
600, the videos taken by the plural video cameras 10 
are displayed on plural video display areas 610, 612, 
614, 616, 618 and 620 respectively. In the present 
embodiment, although six areas are shown as an example, 

25 it is not limited to this example. Also, the areas may 
be displayed on the same screen as that of the window 
shown in Fig. 3 or 4. Numeral 632 denotes a trash can 



- 16 - 



icon which is used "to delete the displayed video from 
the video display area. 

Numeral 640 denotes a video camera control panel 
which includes camera control buttons for the video 
5 camera 10. It is possible by handling these buttons to 
control the panning, tilting, zooming, focusing and 
irising operations of the video camera 10, record and 
delete the preset information, and transmit the preset 
information to the video camera. 

10 Numerals 641, 642 and 643 denote preset 

information buttons for performing operations to the 
preset information of the video camera being operated. 
An operation by each button corresponds to one preset 
information and one preset symbol . 

15 Buttons 644 and 645 are used together with the 

buttons 641 to 643. The button 644 is used to give an 
instruction of storing the preset information and the 
button 645 is used to give an instruction of deleting 
the preset information . 

20 In the present embodiment, three preset 

information can be stored into the one video camera. 
However, if means for specifying the preset information 
can be more prepared by increasing the buttons, it is 
not limited to the above case. Further, it may be 

25 structured that the map is changed every click on the 
tab and the registered preset information can be 
instructed by the buttons 641 to 643 corresponding to 
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the clicked map. According to this structure, the 
number of the preset information to be controlled can 
be increased without changing the number of buttons. 

Next, the graphical user interface (GUI) of the 
video communication system according to the present 
embodiment will be explained with reference to Figs. 6, 
7 , 8, 9 and 10. In the present embodiment, if the 
camera icon on the map 520, 530 or the like is dragged 
and dropped (i.e., a drag-and-drop operation) onto the 
arbitrary video display area within the video display 
window, the motion video transmitted from the video 
camera corresponding to the dragged and dropped icon is 
displayed on the video display area onto which the 
camera icon is dropped. 

Fig. 6 is the view showing the state when the 
display is performed by the drag-and-drop operation, 
according to one embodiment of the present invention. 
Concretely, Fig. 6 shows the state that video camera 
icon 523 is dragged and dropped onto the video display 
area 614. Fig. 7 is the view showing the mouse cursor 
of the video camera used in the drag-and-drop operation 
according to one embodiment of the present invention. 
Fig. 8 is the view showing the state when the display 
area by the drag-and-drop operation is changed, 
according to one embodiment of the present invention. 
Fig. 9 is the view showing the camera icon representing 
that the taken video is being displayed, according to 
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one embodiment: of the present invention. Fig. 10 is 
the view showing the state of the operation to stop the 
display by the drag-and-drop operation according to one 
embodiment of the present invention. 
5 In the present embodiment, during the drag-and- 

drop operation, the shape of the mouse cursor is 
represented as a camera shown in Fig. 7, whereby the 
P user can confirm that the drag-and-drop operation is 

Of being performed. At this time, on the basis of the 

uj 10 location information of the dragged camera, the map 

.3.;;. 

5 i S 

— 

Sj management software 413 searches for the ID number of 

Cm 

2 the camera concerned, and notifies the video reception 

sj software 412 of the ID of the dragged and dropped 

PS = 

Li;; camera. On the basis of the notified ID, the video 

f s, = 

15 reception software 412 searches for the panning and 

tilting of the camera, the camera name and the name of 
the host computer to which the camera is connected, and 
notifies the camera control client software 411 and the 
map management software 413 of such information. 

20 The camera control client software 411 

communicates with the camera control server software 
421 of the video transmitter 20 to which the video 
camera 10 is connected, through the network 100 in 
accordance with the notified information. Hereafter, 

25 the operation of the video camera 10 connected to the 
video transmitter 20 is controlled between the camera 
control client software 411 of the monitor 60 and the 
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camera control server software 421 of the video 
transmitter 20 connected. The information concerning 
the panning operation, the tilting operation and the 
like of the camera is notified from the camera control 
client software 411 to the video reception software 412 
for a predetermined time. 

The video reception software 412 notifies 
information of the camera (panning, tilting, imaging or 
the like) to the map management software 413 for a 
predetermined time. The map management software 413 
changes the displaying state of the camera icon 
(panning and tilting) corresponding to the camera on 
the map based on the notified information, displays the 
preset symbol and deletes the preset symbol. 

The camera control client software 411 also 
manages the preset information. 

Storage of the preset information, storage of a 
position of the preset symbol, transmission of the 
preset information to the camera and deletion of the 
preset information will be explained with reference to 
Figs. 12, 13, 14 and 15. 

Fig. 12 is a flow chart showing a storage 
procedure of the preset information. The preset 
information is recorded as follows. That is, 
initially, the preset information storage button 644 is 
clicked by the mouse (step S1204) after operating the 
imaging apparatus to have panning, tilting and zooming 
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values desired to be stored as the preset information 
(step S1202). Next, a desired position of displaying 
the preset symbol is designated by clicking that 
position on the map by the mouse (step S1205). Then, 
5 an arbitrary preset information button among the 
buttons 641 to 643 is clicked by the mouse (step 
S1206). As above, the preset information and the 
position of the preset symbol relative to the preset 

Ve:r 

^- information buttons are stored (step S1208). 

tfP 10 The camera control client software 411 sends a 

03 

SI notification to the map management software 413 when 

= the preset information is stored. On the basis of this 

\\ notified instruction, the map management software 

r : | synthetically displays the preset symbol corresponding 

,«j 15 to the preset information button onto the stored 

position on the map. 

As referred to Fig. 13, the preset information can 
be transmitted to the camera as follows. 

When the preset information buttons 641 to 643 are 
20 clicked by the mouse (step S1302) in a state of being 
selected the camera icon corresponding to the imaging 
apparatus which is displaying video upon being 
performed a displaying operation, the correspondingly 
stored preset information is sent from the camera 
25 control client software 411 to the camera control 
server software 421 (step S1304). 

In this state, the same effect can be obtained by 
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an operation of directly clicking the camera symbol by 
the mouse without clicking the preset information 
buttons 641 to 643. Hereinafter, a transmission 
procedure for transmitting the preset information to 
5 the camera by clicking the preset symbol by the mouse 
will be explained with reference to Fig. 15. 

When the map is clicked by the mouse (step S1502), 

□ 

the map management software 413 checks whether or not 

u * 

H' there is the preset symbol onto a clicked position 

fij 10 (step S1504). If there is, it is checked whether or 

0| not the imaging apparatus relative to the preset symbol 

p is imaging the video (step S1506). When the imaging 

fH apparatus is imaging the video, an instruction of 

J:;; transmitting the preset information corresponding to 

^ 15 the preset symbol is notified to the camera control 

client software 412. Then, the camera control client 
software 412 sends the preset information to the camera 
control server software (step S1508). 

In the present embodiment, the number of the 
20 preset symbol is to be corresponded to the serial 

number of the preset information buttons on the camera 
control panel . 

Fig. 14 is a flow chart showing a deletion 
procedure of the preset information. The preset 
25 information deletion button 645 is clicked by the mouse 
( step S1402 ) , and the preset information button to be 
desired to delete the preset information is clicked by 
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the mouse (step S1404). Then, the preset information 
relative to the clicked preset information button can 
be deleted (step S1406). 

When the preset information is deleted, the camera 
control client software 411 sends the notification to 
the map management software 413. On the basis of the 
notified instruction, the map management software 
deletes the preset symbol corresponding to the preset 
information deleted from the map. 

In case of setting the preset information, an 
imaging video of whole area which can be taken by the 
video camera 10 (a sector area AOB in Fig. 4) is to be 
displayed on the bit map display 135. The operator 
sets the preset information with use of the mouse 128 
while observing the video. 

Concretely, the operator instructs a desired 
position on the display of the above whole area. 
Accordingly, information of the desired position is 
sent to the video camera 10 through the network 100 and 
the video transmitter. 

In accordance with this position information, the 
video camera performs the panning and the tilting 
operations and takes video including the instructed 
position to send it back to the monitor 60. 

The operator instructs direction (panning and 
tilting) and zooming of the camera through operations 
at the video camera control panel shown in Fig. 5, 
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while confirming the bit map display 135 on which the 
video is displayed. When the video camera maintains a 
state desired by the operator upon confirming the taken 
video which is continuously changed according to the 
5 instruction, the preset information (panning, tilting, 
zooming and irising values at that time) is set by the 
operator to click the above preset information storage 
button by the mouse. 

As above, the operator can intuitively grasp the 

10 preset positional relationship of the imaging object by 
displaying the preset symbol on an arbitrary position 
desired by the operator. 

Since the imaging apparatus can be controlled on 
the basis of the corresponding preset information by 

15 clicking the preset symbol by the mouse, not only it 
becomes possible to easily control the imaging 
apparatus using only the map, but also it becomes 
possible to quickly turn a face of the imaging 
apparatus to the direction of the imaging object. 

20 The operator can give a title from the keyboard 

130 according to the preset information which was set 
as above. This title is stored into the storage unit 
126 of the monitor 60 or the external memory 125, 
corresponding to the preset information. 

25 The title corresponding to the preset information 

(position) is displayed when an instruction image 
(arrow mark) of the mouse 128 is moved onto the preset 
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symbol. When the instruction image (arrow mark) of the 
mouse 128 is moved onto the camera symbol 531 shown in 
Fig. 4, a preset display button which was set to the 
video camera of the symbol 531 may be displayed. In a 
5 case where the map is not complex, the title may always 
be displayed. The above process is also executed under 
the control of the camera control client software 411 

O 

,[1 after the process in the step S1206 shown in Fig. 12. 

lV In this way, by giving the title corresponding to the 

a;: 
"fc: : 

fjS 10 preset information (position), it becomes possible to 

m understand why the operator sets the preset 

iL information, in a few days. 

According to the above display of the preset 

5 

C3 symbol, the operator can grasp the positional 

CI 3 

C3 15 relationship of the imaging object which was preset. 

The map management software 413 updates the map 
stored in the video board 136, thereby changing the 
direction of the camera icon according to the direction 
of the actual video camera 10, drawing a scope 910 
20 (Fig. 9) representing that the video (or the image) 
taken by the video camera 10 concerned is being 
displayed, and drawing a control pointer 920 (Fig. 9) 
to control the panning, tilting and zooming operations 
of the camera, the preset symbols, for example, 531-1, 
25 531-2 and the like within the scope 910. 

Further, the information concerning the panning 
operation, the tilting operation and the like of the 
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camera is notified from the video reception software 
412 to the map management software 413 for a 
predetermined time. Thus, if the panning state, the 
tilting state, the zooming state and the like of the 
5 camera, and the presence or absence state of the preset 
information are changed on the camera control panel 
640, such the changes are reflected on the displaying 
states of the camera icons 521, 522, 523, 524 and the 
like, and the preset symbols 531-1, 531-2 and the like. 

10 The actual image data is transmitted from the 

video transmitter 20 in accordance with the request 
from the video reception software 412 of the monitor 
60. The video reception software 412 transmits a 
command to the video transmission software 422 of the 

15 video transmitter 20 to which the video camera 10 

concerned is connected, through the network 100. This 
command is to request data transmission of one frame. 
The video transmission software 422 receives the 
command, divides the captured latest frame data into 

20 packets, and then transmits these packets to the video 
reception software 412. The video reception software 
412 restructures the image frame from the received 
packets, displays the restructured image frame on the 
video display area, and again transmits the video 

25 transmission request command. By repeating such 
operations at high speed, the video at the remote 
location is transmitted and displayed through the 
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network 100. Thus, the video taken by the video camera 
10 remotely located is displayed on the bit map display 
135 of the monitor 60. 

When the videos taken by the plural video cameras 
5 10 are displayed on the screens, the video transmission 
request command is issued, the captured video is 
compressed, the frame is divided into the packets, the 

O 

^3 divided packets are transmitted to the network, the 

cn 

M' packets are received, the frame is restructured, the 

10 compressed data is decompressed, and the decompressed 

! 

Efl video data is displayed in turn and repeatedly, for 

ri each of the video transmission software of the video 

rfi transmitter 20 to which each camera is connected. 

«5 The video taken by the video camera can be shifted 

15 by dragging and dropping the displayed video to the 

desired video display area as shown in Fig. 8. Fig. 8 
shows the state that the video taken by the video 
camera icon 523 displayed on the video display area 614 
is shifted to the video display area 612. At this 
20 time, the video reception software 412 clears the area 
614, and changes internal parameters such that the area 
612 (i.e., the drag-and-drop destination) acts as the 
video display area of the video of the camera 10. 
Hereafter, the video taken by the video camera 10 
25 concerned is displayed on the drag-and-drop 

destination. It should be noted that the logical 
network is not disconnected even by such the operation. 
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Namely, as described later, the once-connected 
communication network is not disconnected until the 
video display area displaying the video is dragged and 
dropped into the trash can icon* 

The display of the video taken by the video camera 
10 is stopped as shown in Fig. 10. Namely, the video 
display area on which the video intended to be deleted 
is being displayed is dragged and dropped into the 
trash can icon 632 within the video display window. 
Fig. 10 shows the state after the display of the video 
of the video camera icon 523 on the video display area 
614 is stopped. At this time, the video reception 
software 412 clears the area 614 to stop issuing the 
video transmission request command to the software 412 
of the video transmitter 20 connected till then. 
Further, the video reception software 412 notifies the 
camera control client software 411 and the map 
management software 413 of the fact that the display 
was stopped. 

The camera control client software 411 receives 
such the notification, disconnects the network to the 
video transmitter 20 connected, and clears the 
corresponding video display area. Further, the map 
management software 413 eliminates the scope display 
from the icon 523 of the video camera concerned, and 
updates the map. 

As other embodiments, the present invention is 
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applicable "bo a system composed of plural equipments 
(e.g., a host computer, an interface equipment, a 
reader, a printer and the like) or to an apparatus 
including a single equipment (e.g., a copying machine, 
a facsimile machine or the like). 

It is needless to say that the object of the 
present invention can be achieved in a case where a 
storage medium storing the program codes of a software 
for realizing the functions of the above-described 
embodiments is supplied to a system or an apparatus and 
then a computer (or CPU or MPU) in the system or the 
apparatus reads and executes the program codes stored 
in the memory medium. 

In this case, the program codes themselves read 
from the storage medium realize the functions of the 
embodiments, and the storage medium storing such the 
program codes constitute the present invention. 

The storage medium for supplying the program codes 
can be, for example, a floppy disk, a hard disk, an 
optical disk, a magnetooptical disk, a CD-ROM, a CD-R, 
a magnetic tape, a non-volatile memory card, a ROM, or 
the like. 

It is needless to say that the present invention 
also includes not only the case where the functions of 
the embodiments are realized by the execution of the 
program codes read by the computer, but also a case 
where an OS (operating system) or the like functioning 
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on "the computer executes all "the process or a part 
thereof according to the instructions of the program 
codes, thereby realizing the functions of the 
embodiments . 

5 Further, it is needless to say that the present 

invention further includes a case where the program 
codes read from the storage medium are once stored in a 
memory provided in a function expansion board inserted 
in the computer or a function expansion unit connected 

10 to the computer, and a CPU or the like provided in the 
function expansion board or the function expansion unit 
executes all the process or a part thereof according to 
the instructions of such program codes, thereby 
realizing the functions of the embodiments. 

15 According to the present invention, the state of 

the imaging apparatus such as the direction of the 
imaging apparatus and the like according to the stored 
control information can be easily grasped. Also, the 
relationship among the plural control information can 

20 be easily grasped. 

Image data which is changing is to be displayed on 
the display device by controlling the imaging 
apparatus. The storage means stores as the control 
information the state of the imaging apparatus when an 

25 instruction was given by an instruction device. 

Accordingly, it becomes possible to store the control 
information after confirming that how the video is 



- 30 - 



taken by the imaging apparatus. 

It becomes possible to easily speculate that the 
control information was what kind of information and to 
provide the control information with a state of not 
5 confusing a user visually- Further, the control 
information can be easily deleted. 

In a case where a position of the preset symbol is 
u3 fixed and the map is not very precise, there sometimes 

LI I 

H occurs such the situation that an object image does not 

£d 10 exist in the direction of the camera symbol. However, 

m since the preset symbol can be put on an arbitrary 

p position, positioning between the preset symbol and the 

fit object image can be performed without reforming the map 

precisely. 

" t? 15 Further, the imaging apparatus can be easily and 

intuitively controlled without redundancy by providing 
an operation means for the preset symbol on the map. 



